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We propose an extended public goods interaction model to study the evolution of cooperation in 
heterogeneous population. The investors are arranged on the well known scale-free type network, 
the Barabasi-Albert model. Each investor is supposed to preferentially distribute capital to pools 
in its portfolio based on the knowledge of pool sizes. The extent that investors prefer larger pools is 
determined by investment strategy denoted by a tunable parameter a, with larger a corresponding 
to more preference to larger pools. As comparison, we also study this interaction model on square 
lattice, and find that the heterogeneity contacts favors cooperation. Additionally, the influence of 
local topology to the game dynamics under different a strategies are discussed. It is found that the 
system with smaller a strategy can perform comparatively better than the larger a ones. 



I. INTRODUCTION 

The evolution of cooperation among unrelated individ- 
uals is one of the fundamental problems in biology and 
social sciences [H, 0, @1 ■ A number of mechanisms have 
been suggested which are capable of supporting coopera- 
tion in the absence of genetic relatedness. Most notably, 
this includes repeated interactions and direct recipr ocity 
d, indirect reciprocity [1, B, B , punishment H, fiof . 
spatially structured populations [3. fill fl2. Ila, Kbl , or vol- 
untary participation in social interactions |3lll4l [l5l. [l6| . 

The public goods game (PGG), which attracted much 
attention from economists, is a general paradigm to ex- 
plain cooperative behavior through group interactions 
[17| . In this game, the defectors who do not contribute, 
but exploit the public goods, fare better than the co- 
operators who pay the cost by contributing. Thus, 
the defectors have a higher payoff. If more successful 
states spread, cooperation will vanish from the popula- 
tion, and the public goods along with it. By consid- 
ering the fact that who-meets-whom is determined by 
spatial relationships or underlying networks, Szabo and 
Hauert et al. have recently studied evolutionary PGG 
in spatially structured populations bound to regular lat- 
tices | 3l. | l 4, 18|| as well as the well-mixed population 
@) Il6lll9l 2fj|]. In these work, the effects of compul- 
sory and voluntary interactions of agents are also dis- 
cussed. Several factors such as the voluntary participa- 
tion [l8| , and small density of population 20] , which re- 
sult in small size of interaction group, are found to be 
capable of boosting cooperation. 

However, it has been recognized that regular graphs 
constitute rather unrealistic representations of real- world 
network of contacts (NoCs), in which local connections 
(spatial structure) coexist with long-range connections 
(or shortcuts). Also, connections in real- world networks 
are heterogeneous, in the sense that different individu- 



als have different numbers of neighbors with whom they 
interact. Indeed, these features have been recently iden- 
tified as characteristic of a plet hora of natural, social and 
technological networks [2ll. |22|. |23| , which often exhibit a 
power-law dependence on their degree distributions. In 
addition, it is well accepted that the heterogeneity of 
network oft en play s crucial roles in determining the dy- 
namics [13, l25l . l3l| . Therefore it is worth investigating 
the public goods interactions on scale-free network. 

In this paper, we propose an extended PGG model to 
study the evolution of cooperation and investment be- 
havior upon heterogenous networks. It is known that, 
in order to reduce risk, investors may take a p ortfolio 
consisting of wide variety of joint enterprise [26(. In the 
viewpoint of investors, some enterprise may be more at- 
tractive than others, i.e., there exists heterogeneity of 
attractiveness. In our previous work, we have studied 
the the effect of heterogeneous influences on the evo- 
lution of cooperation in the prisoner's dilemma game 
[111 IHIll- Here, in the framework of PGG, we will con- 
sider the effect of heterogeneity of common pools (which 
we call pools' "attractiveness" A) on investors. In our 
model, investors having public goods interactions occupy 
the vertices of the underlying network, with the edges 
denoting interactions between them. Investors are as- 
sumed to be aware of the sizes of pools, based on which 
pools' attractiveness can be estimated. The attractive- 
ness of one given pool also depends on the investment 
strategy a of the system, which regulates the extent of 
investors' preference to large pools. It will be shown that, 
compared with the homogeneous network, the heteroge- 
neous graphs generated via the mechanisms of growth 
and preferential attachment (PA) can distinctively favor 
cooperation, where, in addition, smaller a strategy favors 
cooperation more than larger a strategy. 



II. OUR MODEL 
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Investors in our model are arranged on certain kind of 
underlying network and interact only with their immedi- 
ate neighbors. A given investor j acts as an organizer of 
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the common pool j with size kj+1, where there occurs the 
PGG involving j itself and its neighbor investors. Here, 
kj is the degree of j. Meanwhile, investor j will partici- 
pate in the kj + 1 pools which we named the 'portfolio' 
of j including kj pools organized by its neighbors, and 
the one pool by itself. The common pool j accumulates 
capital from all its participant investors, and then equally 
shares the profit to them. We assume that investors have 
the capacity for learning the sizes of pools in their own 
portfolio, which enable them to discriminate pools by es- 
timating the attractiveness quantitatively. The value of a 
given pool i's attractiveness to investors is Ai = (fc; + l) Q , 
with the real number a denoting the investment strategy 
of the system, which regulates the extent of investors' 
preference to larger pools. We can see that, the larger 
the a is, the more attractive the large pools will be. The 
total amount of capital distributed by a cooperator (state 
s = 1) is normalized to unity, while that of a defector 
(state s = 0) is zero, which implies that defector with- 
hold its investment to free ride the other investor's con- 
tributions. Investors' capital will be distributed to pools 
proportional to the attractiveness. Thus, the amount of 
capital investor j distributes to one of its pool i at time 
t is, 



(a) 



o 

CL 



Djdt) = 



*A-i ' Sj (^) 



E 



(1) 



where J\f(x) is the community composed of the nearest 
neighbors of x and itself, and s j (t) is the state of investor 
j at time t. Investors will equally distribute their capital 
into pools in portfolio when a = 0. They invest large 
fraction of capital into larger pools for the case of a > 0, 
or into smaller pools for the case of a < 0. If investor j is 
a defector [sj(t) = 0], it distributes nothing to its pools, 
and thereby Dji{t) = 0. 

Then, the amount of capital the pool i accumulates at 
time t can be written as, 
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We can express Eq. ^ in terms of the following matrix 
equation, 
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where the elements of the matrix A are given by, 

'A/ E A j€Af(i) 

otherwise 



After the foresaid investing period, the total amount 
in the pools multiples by a constant factor r, namely, the 
interest rate on the common pools. For simplification, 
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FIG. 1: Average frequencies of cooperators and defectors as a 
function of interest rate r (a), and typical snapshot of the 30 x 
30 square lattice with r = 3.8 (b). Black refers to cooperators, 
and white to defectors. The results in (a) are averaged over 
40 realizations. The rc (ro) indicates the value of r where 
cooperators (defectors) vanish. 



we assume that the profit of each common pool is then 
equally shared to all participants irrespective of their in- 
dividual contribution. Thus the aggregate payoff of agent 
i after one generation is, 
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It can be written as P{t) = rBAS(t), where the 



matrix B has element ba as, 
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Taking into account the unity capital initially distributed 
by cooperator, the total returns of investors can be writ- 
ten as R = P -_S. 

The return R obtained in PGG interactions denotes 
the reproductive success, i.e., the probability that one 
neighbor will adopt the agent's state. In order to max- 
imize total returns, investors update their states after 
each round of game according to the following rule: In- 
vestor i selects one of its neighbor investor j with equal 
probability. Given the total returns (Ri and Rj) from the 
previous round, i adopts neighbor j's state with proba- 
bility [H, [3: 
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1 + exp[(Ri - Rj + t)/k] 



(7) 



where r > denotes the cost of state change, and k 
characterizes the noise introduced to permit irrational 
choices. For k = the neighboring state Sj is adopted 
(4) deterministically provided the payoff difference exceeds 
the cost of state change, i.e., Rj — Ri > r. For k > 0, 
states performing worse are also adopted with a certain 
probability, e.g., due to imperfect information. Following 
the previous work [l4| , we simply fix the value of k to be 
0.1. 
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III. SIMULATION RESULTS 



First, we briefly consider the extended PGG dynamics 
upon square lattice with periodic boundary conditions, 
where the strategy a does not affect the capital distribu- 
tion because of the degree homogeneity. The dynamics 
starts from the random arrangement of investors' states 
either as cooperators or defectors. In Fig. [2a), we show 
the average equilibrium frequencies of cooperators and 
defectors as a function of interest rate r. It is expectable 
that, the curve shows a growth in the frequency of coop- 
erators with increasing values of r. Below the threshold 
value r < rc cooperators quickly vanish, whereas for high 
r > rjj defectors go extinct. For intermediate r the two 
states coexist in dynamical equilibrium. The subscript 
S of rs refers to the vanishing state. Just as was found 
in Refs. [ll|, 03], the snapshot of the dynamics (Fig. 
QJb)) shows that cooperators persist by forming clusters 
and thereby minimizing exploitation by defectors. 

Let us now consider the evolutionary dynamics of PGG 
upon the Barabasi- Albert (B A) model [22, 23] . It means 
that different investors in this system will have portfo- 
lios consisting of different number of pools. Also, some 
pools may absorb capital from many investors, whereas 
other pools may absorb from much less investors. In ad- 
dition, the size of pools exhibits a scale-free distribution 
as the degree of the underlying network, which result in 
very different values of attractiveness. Here, we want 
to point out that, although larger pools have more in- 
vestors, whether they can accumulate more capital than 
the smaller pools still depends on the investment strat- 
egy, preferring the smaller pools (a < 0), the larger pools 
(a > 0), or equally distributing investment (a = 0). 

Numerical simulations are performed in a system of 
N = 4000 investors located on a BA network with av- 
erage connectivity fixed as 4 which is the same as the 
square lattice. That is, the network grows from a com- 
pletely connected network with tuq = 5 vertices, and at 
every time step a new vertex with m = 2 edges is added 
(th e construction of the BA network can refer to Refs. 
[12, HH). Fig. [5] shows the average equilibrium frequen- 
cies of cooperators with different a strategies on BA net- 
works. One can notice that, no matter what the strategy 
a is, the qualitative feature of frequencies of states remain 
unchanged for the BA network. Again three domains are 
observed: defectors dominate for low r < rc, co-existence 
for intermediate values of r and homogenous cooperation 
for high r > rjj. However, we find that the heterogeneous 
structure distinctly favors cooperators, because the Td 
(where defectors vanish) for the BA networks are much 
smaller than that for lattice (see Fig. [I}. Furthermore, 
we notice that the system with smaller a strategy would 
behave better than that with larger a, which implies that 
cooperation are rendered more attractive when investors 
prefer smaller pools rather than larger ones. 
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FIG. 2: Average frequency of cooperators as a function of 
interest rate r with investment strategy a — —2, — 1, 0, and 
1, respectively. Parameters: r = 0.1 and « = 0.1. 



IV. ANALYSIS AND DISCUSSIONS 

We can understand the above-mentioned simulation re- 
sults by the following analysis. From individual perspec- 
tive, the unit investment contributed by one cooperator 
i will be returned to the system as r payoff after each 
round of game. The amount of payoff returned to i itself 
can be written as, 
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Here, j G A/"(i), and L a denotes the weighted average of 
1/(1 + kj) with Aj as weight factor. Thus, how much 
one cooperator can benefit itself from its own unity in- 
vestment depends on interest rate r, investment strategy 
a, as well as its local topology including the degrees of 
its own and its neighbors. For a given investor, the temp- 
tation to defect can be measured in terms of 1.0 — Pa, 
which is actually independent of other investors' states. 
Note that for r > 1/L a the social dilemma raised by the 
PGG is relaxed in the sense that each unity investment 
has a positive net return, and therefore investor can pay 
off better when adopting cooperation rather than defec- 
tion. Here, 1/L a in our extended PGG model in fact 
corresponds to the group size in the original PGG model 
[3j. For the networks with homogeneous degree k, 1/L a 
returns to k + 1 as the value of group size, while for het- 
erogeneous network, the values of 1/L a are various for 
different investors. We give the illustration of Pa on BA 
network in the case that all investors adopt cooperation 
(S = 1). The interest rate r is set as 1.0 so that L a = Pa. 

In Fig. [31 we show Pa of investors as a function of 
their degree iQ, with investment strategy a = —2 (a) and 
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FIG. 3: The Pa of investors as a function of their degree ki 
(square) , and the average Pa over investors with given degree 
(dot) with a = —2 (a), and a = 1 (b), respectively. The 
network is a BA model with N = 10 5 and m = 2. 



a = 1 (b). It is noteworthy in the figures that investors 
with the same degree may have wide range of Pa , which 
reveals the great diversity of agents' individual local con- 
nection. One can notice from the average values with 
a = —2 that the Pa of investors with large degree and 
smallest degree (k — 2) is similar, while that of the in- 
termediate degree investor, especially the k = 3 investor, 
is comparatively small. It is known for BA model that, 
those agents with degree k = m are latterly added follow- 
ing degree- PA mechanism, and thereby more probably to 
have large degree neighbors. When investor prefers small 
pools (a < 0) the investor i with degree k = 2 would dis- 
tribute most of its investment to pool i, and then gain 
1/3 of the profit, with the largest amount approximately 
equal 1/3 [see Fig. [3ja)]. In contrast, agents with k = 3 
still have a neighbor which is younger than them, thus 
more likely to be of small degree. The investor j with 
k = 3 will distribute part of its capital c (the amount 
between 0.0 and 1.0) to its own pool j and then gain c/4, 
with the remained capital gain less than (1 — c)/3 profit. 
Therefore, generally speaking, the Pa of k = 3 investor is 
smaller than that of k = 2 investor. In the inset of Fig. 
EH a), we plot the relations of each k = 3 investors' Pa 
with its 3 neighbors' degree k' . One can notice that, for 
the intermediate degree investors, the separated range 
of Pa [see Fig. [3ja)] is closely related to the k' = m 
neighbor. Those investors with neighbors' minimum de- 
gree k' min — 2 would have larger Pa, while those with 
k' min > 3 are comparatively small {Pa < 1/4). In addi- 
tion, the large degree investors almost deterministically 
have k' min = 2 neighbor pools, which pay them off with 
more profit than the large pools. Thus the corresponding 
ranges of Pa are not separated, and the average values 
are around 0.3 for large degree investors. In addition, 
when a — 1 [see Fig. EJb)], investors are likely to dis- 
tribute most capital into large pools. The decrease of 
the average Pa with agent's degree can be attributed to 
investor's increasing number of large pools, which shares 
the profit to more (other) investors rather than return- 
ing to i itself. From the former analysis, one gets that 
local topology of networks has significant impact on PGG 




2 4 6 8 10 -4 -3 -2 -1 1 2 



r a 

FIG. 4: (a) Average Pa over given degree investors under 
different investment strategies. The strategies from top to 
bottom respectively are a = —2, —1, 0, and 1. And (b) 
the corresponding probability distribution of Pa. The inter- 
est rate r is set as 1.0. (c) The fraction of investors whose 
Pa are larger than 1.0 with the increasing r. (d) The ef- 
fective group size (1/L a ) of network (circle) under different 
investment strategies a, compared with that of square lattice 
(square). The network is a BA model with N = 10 and 
m = 2. 



dynamical process. 

In Fig. Ufa), with respect to the dash line Pa = 0.2 
which denotes the case of square lattice, we show the 
average values of Pa over investors of given degree with 
investment strategies a = —2, —1, 0, and 1. The corre- 
sponding probability distributions of Pa are also given in 
Fig. HJb). The smaller a strategies are found to result 
in comparatively larger values of Pa. This can be easily 
understood from the form of Eq. ([9]) [3(| • The fraction of 
investors who have Pa > 1.0, with the increasing of rate 
r are also plotted in Fig. 0Jc). We see that, in the sys- 
tem with smaller a strategy, more agents are better off 
cooperating than defecting for certain interest rate r, no 
matter what their neighbor investors do. Furthermore, 
we can improve our understanding from the perspective 
of so-called "effective group size" (1/La), which denotes 
the average impact of agent's local topology to the game 
dynamics under certain investment strategy. The effec- 
tive group size (l/L a ) of BA model with m = 2 (circle) 
as a function of strategy a are shown in Fig. [3Jd) ■ In the 
reign of a < 0, the (1/L a ) of BA model is smaller than 
the group size of the square lattice (square) , while in the 
reign of a > the (1/L a ) becomes larger. In this point of 
view, our result is coincide with that of the former works 
[l8l [l9l I20T]. i.e., smaller group of player favor 
cooperators in the PGG. 

From the illustration of S = 1 case, we know that, 
agents' temptation to defect are different because of their 
different local topologies. Furthermore, the system with 
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FIG. 5: (a) Distributions of states in BA network. Coopera- 
tors are denoted by red bars, while defectors by white bars, 
the lengthes of which are proportional to the relative percent- 
age of the respective state for each degree k. (b) Each agent's 
frequency of state updating (open square) during the evolu- 
tion of the system from the initial random state to the final 
equilibrium state within 25000 generations. And the averages 
over agents with the same degree (dot). The simulation takes 
place on the BA network of size N = 1000 and m — 2, with 
interest rate r = 1.6, strategy a — 0, which result in the 
frequency of cooperators pc = 0.684. 



smaller a strategy may render cooperation more attrac- 
tive for the reason that cooperator investors can benefit 
themselves more than those in systems of larger a, which 
therefore relaxes the social dilemma better. 

Similar to the former studies of other games [H], H3j 
HH, the heterogeneity intrinsic to SF NoCs also con- 
tributes to the enhancement of cooperation, by favoring 
cooperators to occupy the large degree agents so as to 
outperform defectors. The detailed description of the oc- 
cupation of vertices with given degree is shown in Fig. 
[5ja). One can clearly find that, almost all hubs are oc- 
cupied by cooperators, whereas defectors present merely 
at low degree vertices. In Fig. [5jb), we plot the state 
updating frequency of each agent during the evolution of 
the system from the initial state to the final equilibrium 
state. From the figures, we know that with respect to 
the small degree agents, the hubs always behave as co- 
operator and rarely change. During the evolution, when 
a hub is a defector investor, it can exploit and may eas- 
ily invade most of its cooperator neighbors. However, 



_in doing so, the number of neighbor cooperators will de- 
crease in subsequent rounds, which in turn acts to re- 
duce the total returns of such defector hub. Whenever 
"its return becomes comparable to that of a cooperator 
-neighbor, invasion may occur. On the contrary, however, 
Dnce cooperators invade hubs, they will tend to increase 
the fraction of cooperator neighbors, in turn maximizing 
their own returns. In other words, once invading a hub, a 
cooperator becomes so successful that it is very difficult 
for defectors to 'trike back', as evidenced by the results 
shown in Fig. [5] 

V. CONCLUSION 

In summary, considering the heterogeneity of real- 
world NoCs, we have proposed an extended public goods 
interaction model in this paper. The investor bounded 
to the underlying network will distribute capital to pools 
proportionally to their attractiveness, which reflects the 
heterogeneous influence of pools on investors, with the 
investment strategy a regulating the value of attractive- 
ness. From the comparative studies of the game dy- 
namics upon square lattice and BA scale-free network, 
we found that heterogeneous structured population par- 
tially resolves the dilemma and improves social welfare. 
On one hand, the hub cooperators always remain stable, 
and spread cooperation to a larger fraction of the agents. 
On the other hand, cooperator investors can pay them- 
selves off with more profit when taking small a invest- 
ment strategy, which relaxes the social dilemma further 
and enhances the reproductive success of cooperation. 

In addition, the qualitative features of the game 
dynamics sustain when the network size N and the 
parameter m of BA networks are different. The networks 
with smaller m are proved to favor cooperation more, 
which can be attributed to the corresponding smaller 
group size [H, [lU . 
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